Astro-WISE processing of wide-field images and other data
نویسندگان
چکیده
Astro-WISE1 (Vriend et al. 2012) is the Astronomical Wide-field Imaging System for Europe (Valentijn et al. 2007). It is a scientific information system which consists of hardware and software federated over about a dozen institutes throughout Europe. It has been developed to exploit the ever increasing avalanche of data produced by astronomical surveys and data intensive scientific experiments in general. The demo explains the architecture of the Astro-WISE information system and shows the use of Astro-WISE interfaces. Wide-field astronomical images are derived from the raw image to the final catalog according to the user’s request. The demo is based on the standard Astro-WISE guided tour, which can be accessed from the AstroWISE website. The typical Astro-WISE data processing chain is shown, which can be used for data handling for a variety of different instruments, currently 14, including OmegaCAM, MegaCam, WFI, WFC, ACS/HST, etc2. 1. Typical Data Processing Chain Astro-WISE was originally designed to handle the large datasets from the OmegaCAM instrument such as the KiDS survey (Verdoes Kleijn et al. 2012). The backbone of Astro-WISE is set by the way it captures all science products obtained in survey operations in an object-oriented data model. Figure 1 shows the main astronomical classes in the Astro-WISE environment, the basic elements of the data processing chain. Each block is a class and each instance of a class is called a Target. The class incorporates a method to derive the data of the Target from other objects, called its dependencies. The user has an ability to combine recipes in a pipeline to process the data by directly requesting the final required data product he or she is interested in. All processing parameters, along with the full data lineage, are saved in the metadata through the persistence of all objects. In the demo the user goes from a RawScienceFrame (raw frame observed by the VST and ingested in Astro-WISE) to a SourceList (the cata1http://www.astro-wise.org 2http://www.astro-wise.org/portal/instruments_index.shtml
منابع مشابه
Astro-WISE Information System
Astro-WISE is a scientific information system for the data processing of optical images. In this paper we review main features of Astro-WISE and describe the current status of the system.
متن کاملAstro-WISE and Grid
The paper reviews the Astro-WISE infrastructure and demonstrates that the Astro-WISE Information System provides a Grid itself. We describe the integration of Astro-WISE with an external Grid infrastructure (BiGGrid). The integration is performed on all infrastructural layers (data storage, metadata and processing layers) with Astro-WISE as a “master” infrastructure. We report the use of the in...
متن کاملThe Astro-WISE approach to quality control for astronomical data
We present a novel approach to quality control during the processing of astronomical data. Quality control in the Astro-WISE Information System is integral to all aspects of data handing and provides transparent access to quality estimators for all stages of data reduction from the raw image to the final catalog. The implementation of quality control mechanisms relies on the core features in th...
متن کاملTracing and using data lineage for pipeline processing in Astro-WISE
Most workflow systems that support data provenance primarily focus on tracing lineage of data. Data provenance by data lineage provides the derivation history of data including information about services and input data that contributed to the creation of a data product. We show that tracing lineage by means of full backward chaining not only enables users to share, discover and reuse the data, ...
متن کاملLofar information system design
The Lofar Information System is a solution for Lofar Long Term Archive that is capable to store and handle PBs of raw and processed data. The newly created information system is based on Astro-WISE the information system for wide field astronomy. We review an adaptation of Astro-WISE for the new tasks and propose a generic solution for the publishing of the data from the Lofar Information Syste...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1111.6792 شماره
صفحات -
تاریخ انتشار 2011